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Preface 


The APU Language Monitoring Team is based at the National 
Foundation for Educational Research in Slough, Berkshire. 


Team members (1985-87): 


Tom Gorman (Project Director) 
Janet White (Deputy Project Director) 
Greg Brooks 

Mary Hargreaves 


Secretary: 
Betty Peasgood 


This booklet is one in a series of APU Language reports for teachers. 
Other titles in the series are listed in Appendix 1(2). 
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1 Introduction 


Reading is a complex activity and we ought not to begin a discussion of the 
way reading was assessed in the APU surveys without clarifying some of 
the assumptions that underlie the measures used. All tests of language 
performance are based on a view about what is involved in using language 
and, more specifically, about what is entailed in reading effectively. 


Reading continuous texts in context 


Prior to 1978, for example, the tests used in national reading surveys were 
designed to show whether pupils had a sufficient knowledge of the 
vocabulary and grammar of language to make sense of isolated sentences. 
Normally, however, we do not communicate by using single sentences 
out of context. Reading generally involves the interpretation of related 
sentences and longer texts in particular contexts of use. Moreover, 
reading for meaning also involves taking account of the intentions and 
beliefs ofthe writer and the unstated assumptions that may underly what is 
written. Pupils who find it difficult to make sense of incomplete and 
unrelated sentences may nevertheless be able to read materials that they 
come across in contexts with which they are familiar and the purpose of 
which they understand. 


Reading, not decoding 


The APU surveys have shown that very few 11 year old pupils are illiterate 
in the sense that they are not able to read many ofthe words and sentences 
that they can understand in speech!. They have mastered the skills that are 
prerequisite to literacy in reading, at least in so far as they understand the 
ways in which letters and combinations of letters relate to the spoken 


! Pupils from special schools or units were not included in the surveys. 
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language. More than this is required, however, for active reading. The 
question is, how well can pupils read the kinds of written materials that 
they are likely to meet in school and in daily life, taking account of the 
purposes underlying their need to read? 


To begin to answer this question, the APU surveys incorporated a 
selection of reading materials that pupils were likely to encounter, 
particularly in the school curriculum. The findings therefore have 
relevance to teachers of all subjects, not just to teachers of English. 


Most of the materials used could be grouped into three main categories 
relating to works of reference, works of literature, and materials that 
would have some application or use outside school. 


Works of reference I 

The tests used in each survey included booklets containing sets of readings 
which were thematically related. The booklets included a page of contents 
and an index and other cues, such as page or chapter headings, which 
pupils need to use when reading reference material independently. In 
many cases the booklets also contained illustrations supplementing the 
text. These included charts, diagrams, tables and maps. The materials 
were devised to have some coherence in content and structure. 


Works of literature 


We thought it important that pupils should be asked to read works of 
literature that were complete in themselves, such as short stories and 
poems, in so far as this was possible. In a small number of cases, however, 
a booklet consisted of thematically related extracts from different sources, 
such as autobiographies. 


Everyday reading materials 


These included extracts from periodicals, such as magazines or news- 
papers, and sub-sections of these such as classified advertisements. Other 
reading materials included forms (to be read and filled in), sets of 
instructions, notices, signs and labels, and listings of different kinds. 


The materials that pupils were asked to read differed in terms of their 
sources and subject matter, in their form and in their possible applications. 
They were selected to be of interest to pupils in the particular age group. 
Wherever possible, they were based on or derived from authentic 
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materials. Finally, the activities pupils were asked to carry out after 
reading were designed to be meaningful, and to be related to the purposes 
for which they would read the materials in normal circumstances. 


Finding out what pupils understand 


Types of questions 


The questions asked about the booklets varied according to the type oftext 
that was being read, its particular uses or applications, and the purposes 
that a reader might have in looking closely at what was written. Generally, 
questions were staged or sequenced in such a way as to focus the attention 
ofthe reader on the main issues that the author wished to highlight, if any. 
A cyclical approach to questioning was adopted, particularly with regard 
to reference materials so that pupils were asked to focus their attention on 
increasingly complex components of the booklet. Though they might 
first be asked to consider specific sections, they would also be asked to 
consider the contents of the booklet as a whole. 


The guiding principle in devising questions relating to the reading 
booklets was that they should be questions that an experienced teacher 
might ask pupils, taking account of the subject matter, the form and 
functions of the passage or passages concerned, and the context in which 
they would be likely to be encountered. 


For example, the efficient use of reference materials generally requires that 
pupils should be able to extract the gist of what is written, relate 
information extracted from different parts of a book, and draw general 
conclusions about what they have read. These concerns would be reflected 
in the types of questions asked about such materials. 


In contrast, questions asked about a newspaper article might focus initially 
on the intentions and motivation of the writer, on whether the article 
contained statements of opinion as opposed to statements of fact and on 
whether or not the language was emotive or otherwise in tone. 


Focus and scope of questions 


The questions asked about different materials varied therefore in their 
focus and scope. The scope of a question refers to the relative amount of 
material that a pupil has to read in answering; which may be a single word 
or sentence, one or more paragraphs, a passage or a complete booklet. 


Differences in the focus of questions relate to aspects of the meaning of 
what is read. Questions may, for example, relate to the ideas conveyed. 
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These may be explicitly asserted, implicitly suggested or presupposed in 
what is written.! Again, all the information required to answer the 
question may be inferred from the text or the pupil may need to draw on 
information derived from personal experience. 


Types of response 


Attempts were made to obtain responses in different forms. After the first 
APU writing survey which provided reliable information about the 
ability of children to respond to questions in writing, the majority of 
questions in subsequent reading surveys were constructed so as to require 
a written response. In some cases, however, pupils were asked to fill in 
forms or tables or to label diagrams. In other cases they were also asked to 
make notes about what they read or to prepare a paraphrase for specific 
purposes. 


H 


Survey constraints 


The design of the surveys placed some restriction on the amount of time 
that any one pupil could be asked to read. It is not possible to ask pupils to 
read longer works of fiction, for example, under survey conditions; nor 
did the reading tasks involve assessors speaking with individual pupils or 
groups of pupils, as is possible in the classroom. Finally, in the initial 
reading surveys it was possible only in a restricted number of cases to 
make use of tasks that involved a sequence of communicative activities 
such as listening, reading and speaking, though such sequences are normal 
in classroom work. It has, however, been possible to include a number of 
integrated tasks of this kind in the APU oracy surveys. 


Attitudes to reading 


It is not enough to enquire about how well children read, if those who can 
read prefer not to or have a very narrow range of reading interests. In 
tandem with the study of pupils' reading performance therefore, the 
research team obtained information about their attitudes to reading. Some 
of the evidence is reported elsewhere in this book.? 


"This issue is discussed in more detail in GORMAN, T. (1986) The Framework for the Assessment 
of Language. NFER-NELSON for the APU, p.11. 


?See also GORMAN, T. Attitudes to Reading. NFER-NELSON for the APU (in press) ^ 
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2 The Pupils! Response: Literature at 11 
and 15 


In this section of the booklet, we will discuss some of the responses and 
characteristics of pupils who were judged to be good or poor readers on 
the basis of their performance on particular reading tasks or booklets. The 
two groups of pupils concerned are those whose scores placed them in the 
top and bottom 20 per cent of the sample of pupils who completed the 
tasks being discussed. For example, of a sample of primary pupils who 
completed the reading booklet on Chief Sitting Bull, 136 pupils were 
grouped into the top score band and 124 into the bottom band'. 


Understanding stories at age 11 


In the course of the five surveys pupils aged 11 were exposed to a range of 
literature including fictional and autobiographical narratives and poems. 
The evidence obtained showed that nine out of ten 11 year olds enjoy 
reading stories and that most have little difficulty in understanding the 
main story elements relating to setting, plot and character, except when 
the latter have to be inferred from their words or actions rather than from 
direct authorial comment. Most pupils of this age find questions relating 
directly or indirectly to the style of writing difficult to answer, particularly 
as this reflects the writer's viewpoint. 


lThe ten reading surveys conducted between 1979 and 1983 involved between 5,000 and 
7,000 pupils in each case. Five surveys involved 11 year old pupils and five 15 year olds. Each 
of the reading booklets referred to was completed by a nationally representative sample of 
not less than 450 pupils. 
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This point can be illustrated from pupils' responses to a story by Jan Mark 
entitled Nothing To Be Afraid Of. The story tells how a 15 year old girl, 
Anthea, is obliged to take charge of a small boy, Robin, who has lived an 
exceptionally sheltered life under the supervision of Anthea's aunt. On 
being given charge ofthe child she takes him for a walk in a park which she 
fills with fierce, imaginary creatures and dangers. The child is evidently 
terrified but later returns to her house eager for the experience to be 
repeated. 


NOTHING TO 
BE AFRAID OF 


by Jan Mark 


Because the story provides an unusually clearly depicted setting, pupils 
were asked to state with reference to a map the approximate location ofthe 
dangers and the proposed remedies against them. Over 90 per cent of the 
high performers carried out both tasks successfully as opposed to less than 
a quarter of the low performers. However, the answers of about 40 per 
cent of the latter showed that they had understood why the experience of 
the boy in the park led him to ask for a repeat of the experience. That is, 
they had grasped the central point of the narrative. 


Understanding the writer's viewpoint and the style of address 


There is a great deal of humour in the depiction ofthe characters and in the 
portrayal of the young boy's reactions, but less able readers found it much 
more difficult than the more able readers to detect and enjoy the comic 
element implicit in the situation and reflected in the style and tone of 
address. For example, when asked to select any part of the story that 
amused them, high performers typically quoted a genuinely comic turn of 
phrase or description and attempted to explain why this struck them as 
humorous. For example, 


"There's a spare pair of pyjamas in case — well you know, in case' .... It 
makes it more homely and gives the right impression of his fussy 
mother. 


Low performers frequently gave a quotation which had no obvious 
humorous implications and gave no explanation for their choice. 


Fewer than one out of ten of the less able readers perceived from the 
description of Robin's mother, Aunt Lynn, how domineering she was. 
She was, for example, described as 'striding up the path like a warrior 
queen going into battle". In general, they found it difficult to appreciate 
and adopt the viewpoint of the writer and to relate their own experience of 
life to the circumstances and characters described. 


The effect of preconceptions 


Another recurrent source of misinterpretation of stories arises from the 
fact that pupils who are not alert to the writer's intentions tend to impose 
their own preconceptions about characters and behaviour on the stories 
they read. This can be illustrated from the responses of less able readers to 
another story — That Sinking Feeling by Betsy Byars — which depicts how a 
little girl gets revenge on her older brothers and their friends who refuse to 
let her play with them, by pulling the plugs out of a makeshift raft of oil 
drums. 


Inflexibility of mind 


The story is told in the form of a first-person narrative. The sex of the 
narrator is established by linguistic and circumstantial evidence but it is 
not explicitly asserted. (For example, her brother says: 'T'll kill her', and 
her mother advises 'I shouldn't push your luck, madam'.) However, 
among the group 0f52 pupils who were classified as falling into the lowest 
performance band, most, including all but one boy, concluded that the 
narrator was a boy and gave reasons for coming to this conclusion. The 
response may be partly explained in terms of the pupils' acceptance of a 
somewhat stereotyped view of what they considered to be 'boyish' or 
'girlish" behaviour. It is also possible that some pupils identified them- 
selves with the main character to the extent that they disregarded 
distinctions of age and sex. More significantly, however, the response 
illustrates the pupils! unwillingness to modify their initial impression or 
conclusion in the light of subsequent information. 


that 
sinking 
feeling 


Lack of close attention to detail 


The response also reflects a lack of close attention to detail. Another 
example may illustrate this. It is necessary to the interpretation ofthe story 
for pupils to realise that the young girlis vying with a group of older boys 
after being rejected by them. Her resourcefulness and ingenuity triumph 
over strength and numbers. Yet only two out of ten ofthe less able readers 
were able to point to evidence in the text, of which there was plenty, that 
showed that the storyteller was younger than most of the boys. 


Lack of reading stamina 


The story ends with a description of the young girl revealing her 
responsibility for the trick: She says: 'T aid the four drum caps on the table 
and went to sit on Mum's knee.' The pupils were asked:"Why did the 
storyteller go and sit on her mother's knee at this point in the story?' Over 
nine out of ten of the high performing group inferred that she was wisely 
seeking her mother's protection; in contrast, less than two out often ofthe 
less able readers did so. Lacking reading stamina, a substantial number of 
the latter did not reach the end of the story, but the majority of those who 
did missed the point of the child's move to her mother's knee, as she 
outwitted her brothers once again. 


Literal interpretation 


Pupils also read a third story, entitled King Lion. The story is written in the 
manner of a fable, in which a small animal (a ground squirrel) outwits a 
more powerful one (King Lion). In the story, the lion announces that in 
order to save the animals work in fetching his food, he will eat them in the 
order they choose. They are left to decide how to put his suggestion into 
practice. The squirrel saves the day by leading the lion to a deep pool 
where, he alleges, a fierce animal is waiting to challenge him. On seeing 
his reflection in the water, the lion jumps into the pool and is drowned. 


A literal interpretation of the words spoken by King Lion would lead 
readers to suppose that the lion was a kind and considerate ruler. For 
example, the lion says: 'In order to improve the service I'm going to make 
a small change in the way things are done. It's been inconsiderate of me to 
make all of you come with the food. You're overworked.' More than half 
of the pupils in the low performing group took this to mean that the lion 
was genuinely concerned about the welfare of the subjects. 


A literal interpretation of the story would also lead pupils to infer that the 
squirrel was a loyal subject, ready to sacrifice himself, as requested. Pupils 
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who imposed this interpretation on the story would, however, find it 
difficult to understand the final episode when the squirrel tricks the lion. A 
substantial number of the less able readers adopted this interpretation. To 
reconcile the apparently conflicting ideas in the final episode, some pupils 
supposed that there really was another animal lurking under the surface of 
the water. 


In both these cases misunderstanding arose, not from an inability to read 
what was written, but from a misinterpretation of the intention of the 
writer in telling the fable and from a certain doggedness in maintaining a 
literal interpretation of what was said. 


Lack of awareness of metaphor and connotation 


It would be possible to maintain a literal interpretation only by ignoring 
some of the indirect clues given about the character of the lion, several of 
which were conveyed in the connotations of the words selected (e.g. *He 
looked at his subjects with a cold eye."). To understand the story, pupils 
had therefore to be sensitive to the style of the story, as well as its content. 
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Understanding literature at age 15 
Interpreting the author's viewpoint and intentions 


The interpretation of literature involves both an intellectual and an 
affective response to what is written. While literate pupils are capable of 
responding to stories that are appropriately selected, they differ in their 
ability and willingness to respond thoughtfully and with feeling to what 
they read. They differ also in their acquaintance with different literary 
forms and conventions. Not all appreciate that the 'stance' adopted by a 
narrator is not necessarily a reflection of the author's own viewpoint; nor 
do they recognise that the author's views are not necessarily to be 
identified with those expressed by the characters portrayed. 


In the 1983 survey this fact was indicated most clearly in pupils' responses 
to extracts from Aldous Huxley's Brave New World. The author's 
abhorrence of the cloning process in the Central London Hatchery and 
Conditioning Centre has to be deduced from the description of the 
activities rather than from commentary by the writer. However, fewer 
than half of the pupils completing the task in 1983 realised that the author 
viewed the process with distaste. To recognise this requires an imaginative 
interpretation of the words and images that the writer uses to describe the 
fertilising room. Successive metaphors convey an impression of life- 
lessness, frigidity and a lack of humanity (e.g. 'the overalls of the workers 
were white, their hands gloved with a pale corpse-coloured rubber, the 
light was frozen, dead, a ghost. . ."). 


Pupils were asked: Now that you've read the passage, do you think that 
the writer (who wrote in 1932) was in favour of applying 'the principle of 
mass production' to the production of embryos? 


Just over half of the pupils recognised that the writer was opposed to the 
principle. Only one in five pupils in the low performing group reached 
this conclusion, however. For the most part they appeared to be unable to 
distinguish between the author's viewpoint and those expressed by the 
Director of the Hatchery, and they were unconscious of the element of 
irony in the description as a whole. 


Interpreting style and tone of address 


As we noted in the commentary on the answers of younger pupils, better 
readers are aware of the implications and effects of stylistic choices. Both 
in general terms and in terms of the language attributed to characters they 
are alert to the connotations as well as the denotations of the words used. 
The pupils who read the extract were asked to list three words or phrases 
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that helped to make clear the author's feelings about the work being done. 
Between 30 and 40 per cent noted some ofthe phrases that indicated a sense 
of the lifelessness and lack of humanity apparent in the technological 
replacement of the old methods of reproduction; and not more than half 
were judged to have responded adequately to the question. 


Another of the stories that secondary pupils were asked to read was The 
Landlady by Roald Dahl. In this story a young man is depicted as visiting a 
town for the first time to find accommodation before starting work. Late 
in the evening he finds lodgings at a guest house. The landlady has a 
number of eccentric characteristics but, again, her intentions can only be 
deduced from what she says and from what she is described as doing. 
Gradually, evidence accumulates to indicate to the reader that Billy is in 
some danger. However, the hero himself remains unaware of this 
possibility, though at the end of the story his suspicions have been 
aroused. 


the 
landlady 
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Integration of narrative components or clues 


The main source of narrative tension and interest in the story, as in many 
thrillers, stems from the fact that the alert reader is in possession of more 
evidence about the landlady than the hero; and is therefore able to become 
conscious of the predicament the characters are in, even though the 
characters themselves are unaware of this. 


The analysis of the answers of high arid low performers showed that one 
difference between the two groups was that the former were able to 
integrate the clues given, on the assumption that the different elements in 
the story had relevance to the work as a whole. Each component was 
assumed to have been included for deliberate effect. 


For example, one question was asked to determine if the pupils had 
recognised the link between three incidents described by the author: the 
way the landlady carried a tea-tray into the room, a strange smell, and the 
bitter taste of the tea. Approximately three out of ten pupils were able to 
establish a plausible link between these incidents. 


A related question focussed on details of the landlady's behaviour. Pupils 
were asked to point to features of the landlady's hands, face or person that 
suggested something sinister about her. Just over half the pupils located 
such a reference, e.g. the description of her 'small, white, quickly moving 
hands and red finger nails' or of the landlady 'smiling down at him [the 
hero] with pale lips' or *watching him over the rim of her teacup'. 


A sense of form 


Good readers have a sense of form which is needed to recognise the overall 
structure ofa story and the elements in it which are deliberately patterned. 
This was reflected for example in a number of pupils' responses to a short 
story by the Australian writer, Geoffrey Dutton, called The Wedge Tailed 
Eagle. In the story, an eagle hawk is hunted and killed brutally by two 
pilots. The writer shows how they become conscious of the barbarity of 
their actions only on the death of the *majestic' bird which is described in 
sufficient detail to bring home the bloody consequences of the *duel'. The 
author begins and ends the story by describing the appearance of an eagle 
high in the sky. While virtually all the high performers appeared to 
understand the significance of the final appearance of the eagle, only a third 
of the low performers did so. 
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Empathy with characters 


Another ofthe stories that pupils were asked to read was a A Horse and Two 
Goats, a story by R. K. Narayan, which depicts an encounter between an 
American tourist and an Indian peasant in South India. The two 
characters, the *old man' and the 'red-faced man', can be regarded as 
representative figures embodying values and attitudes characteristic of 
their different cultures. Apart from the introduction and conclusion, the 
story consists of dialogue between the two men, who speak different 
languages and who have totally different views about a clay statue which 
the tourist wishes to buy. To him, it is an interesting artifact. To the old 
man the statue is an object of veneration. 


Both characters are depicted sympathetically by the author and their 
mutual incomprehension is humorously portrayed. 


The better readers showed a willingness to empathise with characters in 
the story. Their answers reflected an interest in their way of thinking and 
feeling as well as action in a physical sense. 


a horse 
and 
two goats 


by R.K. Narayan 


Some of the negative and favourable comments made are given below: 


Negative reactions 


Comment 1 
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Favourable reactions 


Comment 4 
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Interpretation of narrative 'action' 


A number of pupils strongly objected to the story essentially on the 
grounds that it was 'all talk and no action'. In making these objections 
some pupils stated a preference for the type of narrative action found in 
war comics, these being narratives in which human action is typically 
portrayed with little or no reference to feelings and motivation. 


Restrictions of interest 


Eight out of ten pupils in the higher performance band said that they had 
enjoyed reading A Horse and Two Goats as opposed to two out of ten ofthe 
pupils in the lower performance band; some of whom expressed very 
narrowly-defined views about the kinds of reading they preferred. 


The reactions of some pupils to the stories they read also reflected 
emphatic and restricted views about the types of reading they Sondered 
appropriate to their sex or age. 
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The story The Wedge- Tailed Eagle was boring. We girls like different 
story (sic) not about eagles and war. 


This story The Tunnel by Doris Lessing was far below the level of 


books I am studying for 'O' Level. It was more along the lines of an 
Enid Blyton story. 


These observations, which have focused on negative responses made by 
less able readers, should not obscure the fact that the great majority of 
pupils enjoy reading stories, even when these are as complex as some of 
those referred to earlier. The following response was typical: 


On first reading, the story was not very interesting — but after having 
looked at it more deeply I found that I enjoyed it much more. 
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3 Using Works of Reference at 
11 and 15 


Understanding expository materials at age 11 


Re-evaluation of evidence 


It was suggested earlier that one of the characteristics of the responses of 
pupils who are not good readers is that they are not always willing to 
modify preconceptions that they bring to what they read in the face of 
evidence that might contradict these. 


A willingness to reconsider one's initial judgements was an important 
factor in pupils! work on another booklet entitled Accident. Pupils were 
presented with four versions of a road accident, and after completing 
different tasks which involved making use of and consolidating the 
information, they were asked to decide which of two protagonists (cyclist 
or pedestrian) was responsible for the incident. 


The first set of evidence was inconclusive and blame was attributed to the 
two parties. Subsequently, an additional set of more reliable facts was 
presented to the pupils and they were asked to reconsider their verdicts. It 
was notable that while high-scorers almost unanimously agreed that the 
cyclist was to blame, low scorers were far less willing to change their 
minds although the new evidence unarguably incriminated the cyclist. 
Fifty per cent of the high scorers and only two per cent of the low scorers 
altered their verdicts, shifting the blame from the pedestrian to the cyclist. 
Some low scorers went to great pains to justify their initial decisions while 
others compromised by attributing blame to both people involved. 


Retrieval of information 


In a booklet on the topic of Whales, children were presented with 
approximately 2000 words of material organised into sections which had 
to be scanned or read in detail according to the questions asked. The 
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booklet provided an example of a compilation of expository materials 
related to a single theme. 


The structure and content of the Whales booklet allowed questions to be 
asked on specific passages and there were also questions that involved 
children referring from one passage to another to locate, interpret and 
relate information given. 


Virtually all pupils were able to locate the answer to questions concerning 
single propositions explicitly asserted and prominently located in a 
specified paragraph. For example, 94 per cent were able to state the depth 
to which a sperm whale can dive and 97 per cent were able to distinguish 
whales, as mammals, from fish. 


Most pupils were also quite efficient at reading through a series of related 
paragraphs to locate information asserted or implied in a single statement 
on a specified topic. 


Nearly all pupils were able to make a decision about the main idea or gist 
of a paragraph or passage, a decision which entailed recognising tlíe 
relative significance of different ideas advanced. Ninety per cent did this 
successfully when the central topic (whaling in the last century) was very 
clearly marked or asserted as was done in the first line ofthe first example 
on p. 20; where this was not so the number of pupils responding correctly 
fell to about 75 per cent in the second example, which dealt with the theme 
that whales are in danger of extinction. 


The results on the Whales 
booklet also showed that most 
pupils were able to read selec- 
tively and, if necessary, to ex- 
tract specific information, 
from technically detailed de- 
scriptions such as would be 
encountered in an encyclo- 
paedia. For example, the ma- 
jority (68 per cent) were able to 
extract, locate and interpret in- 
formation relating to the col- 
our of a sperm whale from the 
extract on p. 21. 
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Sperm Whale 


Description: Huge cylindrical head more than 1/3 total length, with 
narrow underslung lower jaws, each bearing 20-30 conical teeth. 
Dorsal fin replaced by series of low humps. Small flippers. Dark slate- 
grey shading to white underneath. 

Maximum length, male 18m, female 12.5m. Weight (male) 51,000 kg. 


Most pupils were not daunted by the linguistic and conceptual complexity 
of the text, given that what was required was scanning and selective 
reading. 


Relating pictures and text 


In the 1983 APU survey, pupils were asked to match pictures of different 
whales against information given in the booklet. Just under 90 per cent 
were able to do this for at least one ofthe pictures (60 per cent of the lower 
performing group). 


Using tables of contents, indices and glossaries 


They were also asked to answer questions relating to the table of contents, 
the index, the glossary and the bibliography. Some of the questions are 
illustrated below: 


At the beginning of the "Whales' booklet there is à CONTENTS PAGE. 
What docs this page tell you? 


Which page would you turn to if you wanted to know more about: 
Whalebone whales Dagc e EM eS 
TToothed whales page ME mee Ee 


How whales manage to 
live in water pacc Er eps 


Small whales like dolphins 
and porpoises page CT] deren. 


At the back of the *"Whales' booklet there is an INDEX PAGE. 
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What does the index page tell you? 


Which page would you turn to in order to find out: 


About seals page(s mua esses 
About killer whales page(S)R oe 
About toothed whales page(s) EOWIU E. mx 
What rorquals are pase(Sa. CNESES Se. 
What krill is page(s) Miu choros cus 
What plankton is pagc(SDauem ems 
How whales communicate page(s) m e — s 
How big whales are pape)" "NEXT 


In using the index and contents page, seven out of ten pupils were able to 
cite page numbers for the 12 topics with complete accuracy. Among the 
group oflow performers, however, pupils found it difficult to explain the 
purpose of a contents page, index or glossary. 


The pupils were also asked to select from a list of books for further 
reading, the books they would refer to, if they wished to find more 
information on a number of topics, i.e. 


1. Why whales live in the Arctic. 
2. How Eskimos catch whales. 
3. Wlhales and other mammals. 


They were given 12 titles to choose from and, in the sample as a whole 
between 50-80 per cent successfully answered the questions. In the group 
of low performers, however, only just over 10 per cent suggested two or 
more appropriate titles. None of the high-scoring group suggested fewer 
than two applicable book titles. 
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Generally, therefore, low scorers were able to pick out relevant items or 
topics using an index or contents page with near to 50 per cent accuracy, 
while high performers frequently did this with complete accuracy. 


When given a reference book, most 11 year old pupils can locate specific 
pieces of information using the cues available. However, we know from 
HMI sources and other evidence that pupils frequently have difficulty 
locating books in a library that are relevant to particular issues!. The 
effective use of library resources is therefore something that requires 
specific training. 


Interpreting the writer's viewpoint in expository materials 


Expository materials are seldom, if ever, neutral in terms of the stance 
taken by the writer. To take account of this, pupils were asked to read 
statements attributed to people who had opposing views on the question 
of the desirability or otherwise of controlling the killing of whales. They 
were asked to assign the statements to a number of people, given some 
initial information about their views. In effect, pupils were asked to infer 
the likely source of statements about whaling on the basis of their style and 
content. Just over half of the pupils were able to do this effectively. 


The significance of this finding lies in the fact that many pupils appear to be 
unaware that expository articles or passages also tend to embody a 
particular view or interpretation of the 'facts' presented. The presentation 
and discussion of alternative sources of evidence about the same events or 
issues helps to make them more conscious of this fact. 


Reformulation of information 


While the interpretation ofinformation given explicitly is often carried out 
very efficiently, such information usually has to be used selectively. It may 
also need to be restructured and reformulated for a particular purpose and 
readership. Many pupils have difficulty in doing this. 


In 1983, one ofthe booklets that was given to the pupils in primary schools 
presented them with information about historical and social aspects of life 
among American Indians in the latter half of the nineteenth century. The 
questions focused, however, on the life of a single individual — Chief 
Sitting Bull. 


!cf. Tabberer R. and Allman J. (1983) Introducing Study Skills. Windsor: NFER-NELSON. 
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As an initial task pupils were asked to locate the sections in the booklet that 
gave some information about Chief Sitting Bull. They did this with 
notable success. Over nine out of ten pupils picked out all six sections. 


24 


The pupils were then asked to insert the major incidents of Sitting Bull's 
hfe on a time-line provided. The completion of the line involved pupils 
identifying, reordering and condensing the information and selecting and 
transposing it onto the time-line. Sixty per cent and 80 per cent of the 
pupils were able to enter information about the Chief's birth and death 
respectively. This was specifically asserted in the text; but the dates of 
other events needed to be worked out on the basis of the information 
given. For example, given the information that Sitting Bull was born in 
1831 and that he was 10 years old when he went on his first hunting trip, it 
required a simple addition to establish that the hunting trip was in 1841. 
Although the mathematics involved were not complicated, less than 10 
per cent of the pupils in the low scoring group correctly made the 
calculation and inserted the evidence on the time-line. 


Provision of unnecessary details 


In providing the information required low performers also had a tendency 
to write much more than was necessary. Frequently a paragraph of 
superfluous descriptive detail was added to accompany a single date. 


Regurgitation of the text 


It was also characteristic of pupils in the low scoring group to copy 
verbatim an inappropriate quotation from the text. High performers in 
contrast, characteristically provided a succinct caption for each event, 
demonstrating an ability to understand the gist of the information and to 
express it aptly in writing. 


Summarising and sequencing the evidence 


Having placed the events of Chief Sitting Bull's life in chronological 
order, pupils were asked to write a short biography, using and expanding 
on the information presented on the time-line which was to act as a guide 
in their writing. To introduce the biography they were also asked to 
reorder information given in the text to give a brief account of some 
aspects of Indian history at the time of Chief Sitting Bull. Approximately 
three in 10 pupils were judged to have done this successfully. The rest 
failed to provide the necessary contextual explanation or referred to the 
topic too cursorily to fulfil the requirements of the task. 
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Among the lower performing pupils approximately two out of ten 
presented the information required in an accurate fashion chronologically. 
About four out often pupils in this group simply copied what was written 
in the text and a similar proportion presented the information in a way that 
took no account of chronology or sequential otdering. 


Even in the high scoring group about one in four pupils simply copied out 
sections they had previously encircled in the information booklet. 
However most of the better readers appeared to have assimilated the 
information and to have exercised some control over it in selecting and 
reordering the evidence needed for the task. 


In carrying out the task, a large proportion of the pupils appeared to be 
reluctant to tamper with the original text. This approach may be 
influenced by the fact that they are not usually asked to recast what they 
read, but rather to treat informative texts as authoritative. The strategy 
might also reflect the fact that some pupils spend a substantial part of their 
time at school copying from books or from blackboards.' 


A sense of relevance and proportion 


Another difference in the patterns of response of low and high performers 
was that, whereas the latter tended to focus attention on the more 
memorable and significant incidents in the life of the chieftain, low 
performers frequently showed an inability to distinguish between what 
was significant in terms of the questions asked and what was trivial. For 
example, between 60 to 70 per cent of the group of low performers failed 
to mention at least two of the four incidents for which Chief Sitting Bull 
was renowned. Their summaries also tended to pay inordinate attention to 
interesting but irrelevant matters such as the massacre of buffalo. Most 
high performers, on the other hand, attributed proportional attention to 
the key events. 


Another point of difference between the two groups was apparent in the 
relative incidence of inaccuracy in reporting events. In their answers, just 
under 25 per cent of the low scorers misrepresented entire episodes of 
Sitting Bull's life. One recurrent cause of such misunderstanding was the 
creation of misleading associations between unrelated items of the text. 


PN 


This information is derived from HMI surveys. 
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An example of such a response is given below. (Inaccurately reported 
information is underlined.) 


Sitting bull was cheif of the Sioux and he was a man who was very good 
at riding and after he showed the people tricks that he could do he went 
back to his tribe and his son had been took a prison and his tribe was 
drawn in to the black hill where black Foots tribe was and the 
government was going to buy the land of the indians The indians Said 
*yes' but one thing the government did not do was pay them the mony. 
when the gold was Found there. After winning the battle little big horn 
he fled to canada. Latter he returned. But he was killed in the battle of 
the Standing rock. when he went to battle he tried to Free his Seventeen 
year old Sun and was murdered. 


Disregard of the text 


The pupils! responses to the Sitting Bull booklet suggested that when less 
able readers were unfamiliar with a topic they tended to regurgitate 
extracts from the booklet in answering questions, presumably lacking the 
confidence to interpret them. When they were familar with a topic, 
however, a contrary tendency was evident; that is, for pupils to disregard 
the text and to assert their own viewpoint or judgement. 


This tendency was also apparent in the answers given to a booklet on the 
theme of Bicycles. The booklet consisted of five sections each containing a 
text, table or chart and a set of questions or tasks. The materials in the 
booklet included different types of writing, such as extracts from 
magazines, government publications and newsletters — sources of infor- 
mation not often encountered in the classroom. For example, pupils were 
asked to read the following text and to answer a number of questions ofthe 
following kind: 


What check should you make on the frame? 
Wheel? 

Brakes? 

Gears? 
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Bicycles for older children 


How should you buy a 

bike? 

We found that most of the 
bikes we bought needed some kind of 
adjustment before they were fit to go on 
the road. Most ofthe bikes had grease on 
the wheel rims, which had to be cleaned 
off before the bikes' brakes would work 
properly. Three-quarters of the bikes 
needed to have nuts and bolts tightened, 
and nearly half needed their brakes 
adjusting. So check the bike yourself 
before it's ridden. We list below the 
things you should check — these are 
especially important if you buy a second- 


hand bike: 


9 Feel over the frame for bumps, 
ripples and cracks; look at it carefully 
from different angles for distortion. Pay 
attention to the front forks — these are 
liable to get bent backwards. Reject any 
frame you have doubts about, it could be 
dangerous. 

9 [Lift the back wheel off the ground 
and push the pedal round - there 
shouldn't be any noise above normal 
running noise, nor should the cranks be 
bent or touch the chain guard. Pull the 


pedals gently towards you away from 
the frame and push them back - there 
should be hardly any movement. 

9 Spin the wheels — they should turn 
easily without wobbling too much, and 
should be clear of the brakes. When a 
properly-balanced front wheel stops 
spinning the valve should be at the 
bottom. 

9 Apply each brake in turn hard, and 
try to push the bike forward. It shouldn't 
move, nor should there be any move- 
ment in the bearings between the 
handlebars and front forks. 

9 Check that the gears work — either by 
getting the child to have a test ride, or by 
putting the bike upside down and 
turning the pedals by hand. 

9 Check that the brake levers and gear 
controls are positioned so the rider can 
operate them comfortably. 

Look for signs of rust. Avoid a bike 
with lots of chips in it or that's been 
repainted anywhere — the rust may still 
be underneath. 

* Check that the handlebar grips and 
handlebar end-plugs are firmly secured. 
9 Shake the bike and listen for rattles. 
Check that nuts and bolts aren't loose. 


The information on this page and the following page is taken from Which? (1978), pp. 473— 
475. 
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Which type of bike? 

Small-wheel bikes These usually adjust 
easily to accomodate a large range of 

sizes of people. We found, though, that 
there was more adjustment in the saddles 
than in the handlebars - so taller people 
tended to have an awkward riding position. 
Small-wheel bikes are not usually as fast as 
large-wheel ones, but are quite 
manoeuvrable. 


Fun bikes Often called 'choppers' (though 
strictly, Chopper is the Raleigh brand 
name). They're usually meant to give the 
impression of an exotic motorcycle - with 
high-rise handlebars, a banana-or bench- 
shaped seat, and the front wheel often 
smaller than the rear wheel. Some children 
find them difficult to manoeuvre. They 
tend to be too heavy. 


Touring bikes These have straight handle- 
bars and large wheels. They don't have as 
much adjustment in the saddle and handle- 
bars as small-wheel bikes, but are faster. 


Drop-handlebar bikes Often called racers 
or sports bikes. The riding position makes 
you more streamlined and able to exert 
more effort, but some children found it 
took getting used to. We also found that 
some children's hands weren't strong or 
large enough to operate the brakes 
properly. Drop-handlebar bikes tend to be 
lighter than other types, and have a 'racing 
saddle which is longer, thinner and harder 
than a conventional, mattress saddle (not 
the acme of comfort, but better for serious 
pedalling). Most of the boys in our survey. 
wanted a drop handlebar bike next time. 
There are few girls" drop-handlebar bikes 
on the market. 
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Over half of the pupils in the national sample were able to carry out the 
task without difficulty; although on all but the initial question less than a 
quarter of the pupils in the lower performing group were judged to have 
given an appropriate or accurate response. One reason for this was that 
their answers were frequently derived from personal experience and 
knowledge advanced without reference to the text. 
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Understanding expository materials at age 15 
Locating and restructuring evidence 


When a sequence of different language modes would normally be required 
in classroom activities, we have attempted to reflect this in a number of 
tasks in the reading surveys. One such common sequence involves reading 
and note-making. In the initial APU surveys a small number of exercises 
incorporated tasks of this kind. 


For example, in the 1980 survey, pupils were asked to extract information 
about the three topics listed below from a passage about five diamonds. 
For each diamond, the information relating to the three points at issue was 
to be found in more than one paragraph. 


1 the country of origin 
2 the colour of the diamonds 
3 the present location of the various diamonds mentioned. 


In another exercise a different group of pupils was asked to make a 
summary of the main points in a passage. They were provided with a list 
of topics which, it was suggested, might be used as sub-headings. In both 
cases, therefore, a framework for note-making was suggested, but it was 
made clear that pupils were free to structure the notes as they thought 
appropriate. 


In extracting and noting the relevant information about the five diamonds, 
pupils had a choice of strategies. They could, for example, devise a 
framework relating to the three topics referred to using the topics as sub- 
headings. Other strategies were also possible. 


Only six per cent of the pupils noted all the available evidence relating to 
the different diamonds. The most popular strategy adopted by this high 
scoring group was to use the names of the diamonds as sub-headings. 


An example of the method of presentation used by pupils in this group is 
given below: 


Kohinoor 


1. Country of origin Owned by the Rajah of Malwa, India. 
2. Colour Name means *mountain oflight'. Stone is 


white. 
3. Presently at Tower of London 


Another method of presentation used by pupils in the highest scoring 
group presented evidence under the three sub-headings given, as in the 
following example: 


Countries of origin 


'The Kohinoor came from India 

'The Orloffalso came from India 

'The Hope diamond came from Africa 

The Jonker diamond came from South Africa 
'The Cullinan diamond was found in South Africa. 


Colours 


'The Kohinoor is white. 
'The Orloffis rose coloured. 
'The Hope Diamond is bluc. 


Present homes of the diamonds mentioned 


The Kohinoor is now in British crown. 

The Hope is in the Smithsonian Institute. 

The Orloff diamond is in the Russian State Treasury. 

The Cullinan and Stars of Africa are now in the Tower of London. 


Twenty-eight per cent of the pupils responding extracted fewer than five 
points of information relating to the diamonds named. The two most 
prevalent characteristics of the scripts which were assigned low scores 
were, first, the failure to relate the information given to specific diamonds 
as was requested, and, secondly, the tendency to reproduce evidence from 
the passage which had no bearing on the points at issue. 


In addition to their accuracy in selecting the appropriate pieces of 
information, the outstanding characteristic of the high scorers was that 
they imposed a framework on the data — whether using a table or sub- 
headings — and that they fitted the evidence into the relevant slots in the 
framework. A relatively small proportion of pupils adopted the most 
economical method of note-making that would suffice to record evidence 
about the three issues. In the majority of cases, the records that were made 
would not have provided a clear basis for subsequent revision. 
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Note-making with reference to a given framework 


A second group of pupils read the same passage but recorded the 
information asked for with reference to the following framework, which 
was given. . 


ENS X Country of Where to be 
origin found now 

PUR MEET I. 
DNRS NNMERO 
FEL OMNE 
E ccm eR 

he - Bee uoo d 


Orloff 


The majority of pupils were able to place the required information within 
the framework. For example, the five questions relating to the country of 
origin ofthe diamonds mentioned were answered correctly by between 58 
per cent and 83 per cent of pupils. 


In another reading survey, pupils were asked to carry out a second exercise 
which involved their making notes on a passage in which the purpose of 
the note-making was specified and in which the task occurred as one of a 
sequence of activities. They were provided with a set of suggestions for 
sub-headings. These were as follows: 


Reason for cutting diamonds. 

Important advances in gem cutting techniques. 
Stages in the process of cutting a diamond. 
Typical shapes used in diamond engagement rings. 


It was stressed that they were free to decide on their own sub-headings and 
to include diagrams and flow charts if they wished. 
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Characteristics of effective summaries 


The pupils' notes were first marked impressionistically by two assessors 
on a rising scale of 1—7, i.e. they were dealt with using the same procedures 
as are used in marking extended writing tasks in the survey of pupils' 
writing.! 


Seven per cent of the scripts were assigned the highest mark of 7. All the 
scripts in this category had the following characteristics: In content the 
notes made reference to all the main points in the passage and showed no 
evidence of misunderstanding of the issues referred to. They made no 
reference to irrelevant or subsidiary issues and took account of the relative 
significance of points made in the commentary, giving appropriate 
emphasis to the main ideas. Pupils in this group all showed an ability to 
take account of related facts given in different parts of the passage and to 
associate these in their summaries. 


In all scripts in the group, the style of expression was neither verbose nor 
cryptic. 


In all cases, also, the layout of the notes reinforced the meaning of the 
text. All the writers employed sub-headings, clearly separated from the 
body of the notes, most commonly by means of underlining. 


Twenty per cent of the scripts were given an impression mark of5. Scripts 
in this category presented an adequately comprehensive summary which 
was restricted to relevant issues. However, in the majority of scripts in this 
category one or more points made by the writer had been misunderstood 
or not given appropriate emphasis. There was a clear tendency for scripts 
in this category to contain reference to information of subsidiary relevance 
and/or to be cursory. Approximately half of the scripts did not use a 
system of sub-headings or adopt a layout which reflected or exemplified 
the main divisions in content. 


T wenty-two per cent of the scripts were given an impression mark of 3. 
Characteristically, they provided no evidence that the pupil was aware 
that the main points in the passage were to be covered. The notes could not 


These have been described in a number of reports. For a summary statement cf. GORMAN, 
T. (1986). The Framework for the Assessment of Language. NFER-NELSON for the APU. 
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be taken to provide an outline of what the passage contained, insofar as 
they were either inaccurate or incomplete in content. Scripts from this 
group contained as wide a range of devices as the scripts of higher 
performers (e.g. numbering, the use of new paragraphs, sub-headings and 
the appropriate use of new lines), but there were fewer examples of these. 
The majority of scripts in this category were presented in the form of one 
or two paragraphs. 


Nine per cent of the scripts were assigned an impression mark of 2. These 
contained information that had a bearing on the passage, but were too 
sketchy to convey an impression of the main points advanced. Those that 
attempted to deal with more than one issue tended to make no clear 
distinction, either in content or presentation, between the different 
matters referred to. 


Interpreting tabulated and illustrated evidence 
Another booklet that involved the interpretation and use of expository 


and documentary materials was a document entitled A World for the Young? 
This was an illustrated 10 page booklet composed of extracts from 
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brochures prepared by *Help The Aged'. The contents were divided into 
several parts falling into two sections: 


1. Facts and figures about the life and living conditions of old people in 
British society. 
2. Reports of interviews with old people. 


The questions and tasks in the answer booklet concentrated mainly on the 
charts and tables of which there were six (bar graphs, pie charts, tables). 
Particular attention was devoted to two tables. Pupils were asked, first, to 
perform a number of interpretative tasks and, second, to describe the 
pattern depicted or the relationship between variables. Reproduced on the 
previous page is a table demonstrating the link between standards of living 
and infant mortality. 


Both low and high performers successfully answered simple questions 
such as: 


What percentage of infants die in their first year in India? 
What percentage of infants die in their first year in the UK? 


Accurate responses were given by 100 per cent and 88 per cent of the high 
and low scoring groups respectively. Performance declined slightly, but 
still showed overall competence, when pupils were asked to select items 
according to a common factor, e.g. 'How many countries on the chart 
have an income of more than $3000 per person?' Seventy-six per cent of 
low performers and 99 per cent of high performers gave the expected 
answer, indicating that the great majority of the sample were able to 
perform tasks involving reference to two or more variables. 


However, another question, which involved basically the same process, 
i.e. the identification of countries sharing a specified feature, proved to be 
more difficult. (Eighty-seven per cent of high performers and 26 per cent 
oflow performers responded accurately.) This item illustrates the effect of 
the wording of the questions on performance, especially in the case oflow 
performers. The question was: 'What countries on the chart have less than 
one doctor for 20,000 people? It differs in wording from the 
corresponding phrase on the chart *more than 20,000 people per doctor'. 
Although almost all (92 per cent) oflow scoring pupils gave a complete list 
of countries sharing a common doctor/patient ratio, most opted for the 
wrong list, being misled by the interchanging use of *more' and "less! and 
by the identical figures. 


The results of high performers were also influenced by the wording of this 
item, but to a smaller degree. Fourteen per cent of the group gave lists 
other than the one requested. 


A. 
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Detecting patterns in tabulated information 


The final question in this section asked pupils to describe the pattern 
emerging from the chart. The evidence indicated that life expectancy and 
infant mortality figures improve as the doctor/population ratio and 
income per capita increase. In all, 81 per cent of high scorers were recorded 
as giving acceptable responses. . 


Low performers encountered certain difficulties with this task and only 19 
per cent of their responses were considered to be appropriate. Some 
described one relationship - the connection between two of the four 
factors involved. Others were over-specific in their answers. They quoted 
figures or named individual countries but did not extend their obser- 
vations sufficiently to derive generalisations applicable to the whole table. 


A tendency to digress 


A large proportion of low scorers digressed from the assigned task either 
by discussing improbable implications, possible corrective measures or 
eventual outcomes, or by proposing explanations without defining the 
trends, e.g. 


It shows that the countries with a higher income per head have less than 
2000 people per doctor this is because they have private doctors. 


Generalising from the evidence 


The booklet concluded with questions that were intended to investigate 
the pupils' ability to abstract information from and form general notions 
about the contents of a booklet after reading through it quickly. The text 
consists of four fairly lengthy sections and since the questions did not 
necessitate close reading, readers were advised to "look through them 
quickly'. The text reports on interviews conducted with four elderly 
people each describing his/her own life, but with certain characteristics 
reappearing in each. 


Pupils were first asked, "What problems do these people seem to have in 
common?' High performers encountered few difficulties in detecting 
features such as loneliness, immobility and poverty that were common to 
the four people interviewed. They characteristically (90 per cent of the 
group) listed two to four points, sometimes interlinking them or 
explaining their cumulative effect. 
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Low scorers, of whom 30 per cent replied appropriately, tended to offer 
one-point answers and over half these concerned the problem of solitude, 
the issue most frequently mentioned by the interviewers. 


The majority of the low scorers seemed to have difficulties in coping with 
the extended texts and those who extracted sufficient information to 
provide an adequate response did not generally exploit the text thoroughly 
and subsequently omitted other relevant points. This type of response was 
also apparent in the answers given to questions asked about *Warminster- 
On-Sea', a test in the form of a travel brochure. 


Making practical use of a brochure 


In style and layout the brochure was designed to be typical of those found 
in British sea-side resorts. 


It offered information on the town's amenities and attractions in prose and 
in the shape of maps, diagrams, advertisements and forms. Pupils were to 
consider these imaginary materials in terms of the requirements of a 
fictitious family (the Marsdens). 


There were essentially two main types of question: 


Warminster 
on 


1) those requiring direct reference to factual information about amenities 
and 


2) those requiring interpretation of information to determine its relevance 
to the needs of the family. 


As might be expected, pupils in both low and high scoring groups did well 
when asked to retrieve explicitly stated information. For example, 81 and 
100 per cent respectively of low and high performers located the correct 
answer to a question about the quickest route for motorists from London. 


Other questions making use of clearly asserted information asked pupils to 
say whether certain facilities, for example a zoo, pony rides or Children's 
Theatre were available in Warminster. 


High performers had few problems in ascertaining whether the facilities 
were provided or not; their scores on the nine items listed ranged between 
82 per cent and 100 per cent. Low performers! scores ranged between 28 
per cent and 79 per cent. Many evidently experienced. problems in 
deciding whether the facilities were on offer in Warminster. In particular, 
their scores fell in relation to questions about facilities which were not 
mentioned in the section of the booklet that dealt with children's 
entertainments. 


In this case also, information that was situated exactly where one would 
expect to find it — under an appropriate heading — was retrieved with far 
greater success than information that necessitated a search of subsidiary 
sections of the brochure. 


Making judgements on the basis of evidence 


Pupils were also asked to consider the applicability of the information to 
the needs of different members of the Marsden family. The question 
below, for instance, asked pupils to judge whether Jane or Michael would 
be more attracted by the sports facilities described: 


Would you say that the sports and entertainments offered would appeal 
more to someone who participated or to someone who just wanted to 
watch? Would they suit Michael or Jane better? 


In responding, they had to determine which of the two children was of an 
active disposition and to investigate whether Warminster's sports 
provisions were more suited to the active sportsman or to the passive 
spectator. A dialogue recorded immediately above the question suggested 
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that Jane was the active member of the family and that Michael was an 
armchair sportsman. The sports listed implied that they would appeal 
most strongly to someone who wanted to participate actively. 


Very few pupils in the low scoring group (18 per cent) arrived at the 
conclusion that Jane would probably appreciate these facilities more than 
Michael, but even fewer claimed that they would appeal to Michael. 
Instead, 35 per cent answered 'yes' or 'no' or offered some comment 
which indicated misinterpretation of the question, e.g. 'someone who 
wanted to walk' or swimming and games'. Twenty-five per cent made no 


reply. 


The success achieved by the high scoring group (75 per cent) reveals that 
the majority made the necessary deductions. Of those that did not, just 
under a half (40 per cent) suggested that both Jane and Michael might find 
the facilities attractive (perhaps because Michael could derive enjoyment 
from watching his active sister). Although their answers were not judged 
to be appropriate in this instance, they did not indicate misunderstanding 
of the question or the text. 


APPLICATION FOR ACCOMMODATION (EXTRACT) 


Accommodation: Hotel/holiday/flatlet 


State number of rooms of each type required. 
Room with 1 single bed E. Room with 1 double and 
Room with 2 single beds 1 single bed 
Room with 3 single beds F. Room with 2 double beds 
Room with 1 double bed G. Room with 1 double and 
2 single beds 


The accommodation is for . . . adults and . . . children 
Ages of children cots required 


Service required: 


Bed, breakfast and evening meal 
Bed and breakfast only 

Full board 

Holiday flatlet 


Approximate amount you wish to pay per person per day: 
(Excluding VAT) 


Children occupying separate rooms are usually charged full rates. 
Any other details 


40 


Reformulation of information 


Pupils were also called upon to put themselves in the place of the Marsdens 
in order to complete an accommodation booking form. 


Most of the information needed to answer the questions on the form was 
conveyed through a reported dialogue between the parents; other 
information, such as the ages of the children, had been included in the 
introductory paragraph on page 1 of the booklet. Although all the 
information to be recorded was explicitly asserted, the success pupils had 
in transferring information from the text to the form depended on the 
location and complexity of the data to be transferred. 


For example, relatively lower scores were obtained by both high and low 
performing groups when they were asked to insert the type and number of 
rooms required. Although the information was stated explicitly in 
dialogue: 'that means we'll want a room with a double bed, a room with 
two single beds and two single rooms', only six per cent of low scorers and 
53 per cent of high scorers provided the equivalent numerical result in the 
correct slot. However, the difficulty pupils had in completing the form is 
as much a reflection of the lack of clarity in the form itself (which was an 
authentic text) as of the pupils! relative inexperience in such exercises. 


To summarise, pupils found it more difficult to extract the information 
required if it was not located in a clearly identifiable section of the text. 
Performance was also affected if the relevant information was located in 
different sections of the brochure. In general, the majority of high 
performers correctly interpreted the information according to the needs of 
the Marsden family, but they found questions that involved such 
additional considerations more difficult than those which simply required 
direct reference to the brochure. 
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4 Summary Observations 


With rare exceptions, pupils at the age of11 are able to read and understand 
extended pieces of writing. The ability to pick out explicitly asserted facts 
— even from quite complex or technical pieces of writing — is common 
among children ofthis age. Similarly, they are competent users oftables of 
contents, indices and glossaries, although the majority of low scorers are 
not able to provide an adequate explanation of the purpose of each of these 
tables. 


Most children are able to draw inferences from information presented 
within the boundaries of a single statement. Likewise, it is quite usual for 
children of this age to be able to explain the main idea of a paragraph or 
passage, provided that there is a topic sentence. 


By contrast, poorer readers find it more difficult to make inferences which 
require the connection of implicit information from two or more separate 
statements, and to draw on relevant extra-textual evidence in constructing 
their answers. Such pupils also have difficulties interpreting the 
implications of changes in the style of address and in recognising the stance 
of the author in both literary and expository texts. The implications of 
metaphorical statements are frequently misunderstood and the con- 
notations of expressive statements not realised. 


Another characteristic shown by some less able readers is the rigidity with 
which they adhere to their preconceptions and to their initial under- 
standing of the text. This is due to an apparent reluctance to reassess their 
interpretations even if incoming information from the text directly 
contradicts what they have understood. The pupils in the surveys were 
frequently asked to explain their responses to questions. It became clear 
that many aberrant interpretations were not unmotivated errors but that 
they reflected a coherent, but partial, understanding of the text, which 
failed to accommodate any information that was not compatible with it: 
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When dealing with long texts, most children are able to locate sections 
relating to a specified topic. However, low performers were able to use the 
information that they themselves had selected with less flexibility than 
were good readers. When asked to rearrange and rewrite such infor- 
mation, poor readers showed a far greater dependence on the exact format 
and wording ofthe original than good readers. High performers generally 
manipulated the information successfully although they were also 
reluctant to produce a response substantially different from that given in 
the printed text. 


A recurrent feature among poor readers is their heavy reliance on personal 
knowledge and expertise when working on familiar topics. Many 
responses are derived from general knowledge or from first-hand 
experience and not from the text. Good readers presumably share the same 
background knowledge on such topics as poorer readers, but they tend to 
relate their answers to evidence provided in the text. 


The responses of low performers also tend to be characterised by a lack of 
close attention to detail. In some cases this will reflect a lack of interest in 
the topic being read about, with a resulting disinclination to make the 
effort required to elucidate the text. Related factors may help to account 
for the lack of 'reading stamina' that was noted in some cases. The more 
text there was to read the more likelihood there was that a substantial 
proportion of poor readers would not complete the tasks given (though 
teachers are encouraged to allow pupils completing APU tests sufficient 
time to read them). 


The findings showed that many older pupils still have difficulty in 
interpreting authorial viewpoint, where this is reflected in the tone of 
address adopted. Again, this generalisation applied to both narrative and 
expository material. It was however, most marked in the inability of 
many pupils to understand the ironic tone and satirical purpose of an 
extract from Brave New World. 


Many pupils also showed a lack of experience in interpreting works of 
literature as integrated compositions in which the different narrative 
components were interrelated. 


The responses of a substantial number of lower performers also reflected a 
lack of interest in more complex forms of narrative action, particularly 
*action' associated with the presentation or development of states of mind. 
A marked restriction in the range of literature they thought to be of 
interest was also apparent in the comments of a minority of pupils. 


The majority of secondary pupils were adept at certain types of infor- 
mation retrieval provided the evidence required could be readily located in 
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one clearly identifiable part of the text. In general the same tendency 
applied to the extraction of information from tabulated materials and 
charts, though the detection of pattern and structure in complex texts 
again posed problems. 


Many pupils experienced difficulty in selecting and re-ordering or 
reformulating information in an economical and succinct manner. Note- 
making from complex texts posed major difficulties to the majority of 
pupils. Responses were frequently characterised by the inclusion of 
unnecessary details, by unselective copying, and a degree of inaccuracy 
which could reflect the fact that pupils do not normally expect their notes 
to be subject to close scrutiny. 
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5 Implications for the Classroom 


* Pupils should meet as wide a range of reading materials as 
possible. By the age of 15, pupils should have been exposed to a range - 
of expository and narrative forms and styles, and to writing used for 
different purposes including argument and speculation. 


* Thereading tasks assigned should nurture a more critical attitude 
towards the printed word. In particular, pupils should be encouraged 
to consider the motives, intentions and opinions of the writers. 


* More emphasis could be given to tasks that involve pupils in 
reformulating, re-shaping and re-ordering information for 
different purposes and audiences or in recasting information 
given into alternative forms. The advent of the word processor has 
made it easier for this to be accomplished and has provided further 
opportunities for reading and writing activities to be more closely 
associated. 


* The simple regurgitation or copying of what is read should be 
discouraged as a means of learning. 


* The way pupils develop as writers can be influenced strongly by 
what they read which provides models of the ways in which writing 
can be organised and presented. When possible, pupils need to be aware 
of models or schema for the tasks they are asked to carry out. For 
efficient note-making, for example, some pupils benefit from 
illustrations showing how extracted information might be categorised. 


* Pupils should be urged to adopt different reading strategies to 
suit different tasks, including skimming extended texts in order to 
pick out main ideas or scanning passages in search of answers to specific 
questions. The questions and tasks should be based on authentic uses of 
materials. 
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Many pupils have entrenched and restricted views about the types of 
reading they prefer or consider to be appropriate for their age-group or 
sex. Reflective reading of well-selected stories and poems or 
extracts from novels, preferably in small groups, may help to 
counter such narrowness of focus. 


Discussion encourages pupils to reflect on their first impressions. 
Through group discussion and small group work in which what is 
written is related to their own experience, less able pupils realise implicit 
meanings. 


Reading should not always result in writing, but in illustration, 
reporting back, drama and so on. 


Some reading tasks, particularly those involving reference to 
different sources, can best be performed collaboratively. A group of 
pupils might be assigned work that entails the use of different texts and 
different reading strategies directed towards the production of a 
common record or shared findings. 


The ways in which available book stocks are deployed in the 
school may need to be considered to ensure that they are readily 
accessible to pupils. The feasibility of increasing the range and variety of 
books available, for example, through school bookboxes, bookfairs, 
bookschemes or a bookshop might also be investigated. 


Pupils need to be reminded about the ways in which reference 
materials are structured and how they can be used efficiently for their 
purposes. 


For the development of reading skills, a well-selected, well- 
organised library is an essential resource. Pupils need to know how 
to locate subject areas on the library shelves and how to identify the 
books they need from those available. 


Note: An accompanying book in this series, Pupils! Attitudes to Reading, by 
Tom Gorman, includes additional information and recom- 
mendations on pupils' reading. Other relevant comments are given 
in Mike Raleigh, The English Magazine, 10, Autumn, 1982. 
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Appendix 1 


Where to get further information 
(a) Related APU publications 


Full details of the 1979 and 1980 surveys are contained in the following 
reports, which may be purchased (if in print) from Her Majesty's 
Stationery Office, 49 High Holborn, London WC1V 6HB, or through 
booksellers. 


GORMAN, T.P., WHITE, J., ORCHARD, L. and TATE, A. (1981). Language 
Performance in Schools: Primary Survey Report No.1. London: HMSO. 
ISBN 0 11 270385 2. £6.40. 

GORMAN, T.P., WHITE, J., ORCHARD, L. and TATE, A. (1982a). Language 
Performance in Schools: Primary Survey Report No.2. London: HMSO. 
ISBN 0 11 270389 5 £7.90. (NB. out of print) 

GORMAN,T.P., WHITE, J., ORCHARD, L. and TATE, A. (1982b). Language 
Performance in Schools: Secondary Survey Report No.1. London: HMSO. 
ISBN 0 11 270387 9. £6.60 - 

GORMAN, T.P., WHITE, J., ORCHARD, L. and TATE, A. (1983). Language 
Performance in Schools: Secondary Survey Report No.2. London: HMSO. 
ISBIN 0:11 270502 5. EO UR. 


No reports on the 1981 surveys were published. The 1982 surveys, which 
were the first to include oracy, have been reported in: 


GORMAN, T.P., WHITE J., HARGREAVES, M., MACLURE, M. and TATE A. 
(1984). Language Performance in Schools: 1982 Primary Survey Report. 
London: DES. 

GORMAN, T.P., WHITE, J. and BROOKS, G. (1984). Language Performance in 
Schools: 1982 Secondary Survey Report. London: DES. 


Details of the 1983 surveys at.both ages, including the oracy components, 
together with an analysis of the complete initial five-year cycle of annual 
surveys, will be found in: 
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GORMAN, T.P., WHITE J., BROOKS, G., MACLURE, M. and KISPAL, A. (1987). 
Language Performance in Schools: Review of Language Monitoring, 1979— 
83. London: DES. 


The last three reports mentioned above have been produced in limited 
numbers, and sent free to local authorities, teacher centres and teacher 
training institutions. Copies may be consulted at educational libraries and 
at the library of the Department of Education and Science, Elizabeth 
House, York Road, London SE1 7PH. 


This booklet is one of a series of short reports written by members of the 
Language Monitoring Team and intended mainly for teachers. The titles 
published to date are: 


MACLURE, M. and HARGREAVES, M. (1986). Speaking and Listening: 
Assessment at Age 11. Windsor: NFER-NELSON. ISBN 0 7005 1112 
1: $95 

WHITE,J. (1986). The Assessment of Writing: Pupils Aged 11 and 15. Windsor: 
NFER-NELSON. ISBN 0 7005 1113 X. £1:95; 

GORMAN,T.P. (1986) The Framework for the Assessment of Language. 
Windsor: NFER-NELSON. ISBN 0 7005 1114 8. £195. 

BROOKS, G. (1987). Speaking and Listening: Assessment at Age 15. Windsor: 
NFER-NELSON. ISBN 0 7005 1115 6. £3.75. 

GORMAN, T. (1987). Pupils! Attitudes to Reading. Windsor: NFER- 
NELSON. ISBN 0 7005 1158 X. £1.95. 

WHITE, J. (1987). Pupils! Attitudes to Writing. Windsor: NFER-NELSON. 
ISBN 0 7005 1159 8. £1.95. 


(b) In-service materials 


The APU has produced two in-service kits of materials, one on oracy at 
age 11, the other on oracy at age 15. The kits consist of a booklet 
describing performance on a number of the tasks used at the relevant age, 
the equipment used in administering these tasks, and a videotape showing 
examples of pupils' performance on those tasks. 


In England and Wales about six copies of each kit have been supplied to 
each LEA for use in in-service training. They may be held centrally by the 
LEA, in teachers' centres, or elsewhere. 


Copies of each kit have also been provided for each teacher training 
institution. Some have been lodged with examination boards. 


The Department of Education for Northern Ireland has also distributed 
copies to education and library boards and to teacher training institutions. 


In case of difficulty, a list of recipients of the kits is available from the 
APU, Room 3/73, Elizabeth House, York Road, London SE1 7PH. 
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